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(57) ABSTRACT 

An image processing method in which color-appearance 
matching of an output image to an input image is achieved 
regardless of ambient light. Color conversion is performed 
on image data representing an input image to fulfil color- 
appearance matching of an output image to be reproduced 
by an image, output device, to the input image. Color 
conversion is performed on the image data representing the 
input image obtained from the input device under a certain 
standard light source into image data dependent on a light 
source used for observation. The converted image data is 
further subjected to color conversion based on a reference 
white color determined when an observation is made. The 
resultant image data is output to the image output device. 
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FIG. 5 
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IMAGE PROCESSING METHOD AND 
IMAGE PROCESSING APPARATUS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image processing 
apparatus for performing color correction in accordance 
with ambient light. The invention also relates to an image 
processing method for use in the above apparatus. 

2. Related Background Art 

Along with the widespread use of color-image products, 
color images are becoming easier to handle, not only in 
specific fields, such as computer graphics (CG) design, but 
also in ordinary small offices. In practice, however, color 
matching cannot generally be achieved between an image 
produced on a monitor and the resulting printed image, and 
it is difficult to check the colors of images on the monitor 
prior to printing. Attention is now focussed on a color 
management system directed to solving the above problem. 

The color management system is constructed to target, by 
using a common color space, the elimination of color 
differences produced by different types of devices. More 
specifically, this system is constructed based on the idea that 
all of the colors represented by the same coordinates in the 
same color space appear alike. Accordingly, color- 
appearance matching is implemented with the use of this 
system, i.e., by expressing all of the colors in the same color 
space and by matching the corresponding coordinates with 
each other. One of the methods which are currently 
employed for correcting differences caused by different 
types of devices is to use the CIE-XYZ color space and its 
internal description coordinates, i.e., the XYZ tristimulus 
values. 

The environment for observing images is now explained 
with reference to FIG. 11. FIG. 11 shows that an image 202, 
which is the same as the image of a printed article 201, is 
displayed on a monitor 203, and ambient light 204 used for 
observing the image 202 and the printed image is detected 
by an ambient-light sensor 206 installed on the monitor 203 
or on a printer. The printed image and the image 202 
displayed on the CRT are not always observed under the 
same ambient light, and the ambient light 204 shown in FIG. 
11 varies according to environmental conditions. Further, 
even though the image 202 on the monitor and the printed 
image appear alike under a certain type of ambient light, 
they may look completely different with a change in the 
ambient light. In order to prevent this problem, the above- 
described color management system is employed, as illus- 
trated in FIG. 10, to predict values (for example, the XYZ 
values) of each image to be observed under a certain type of 
ambient light, based on ambient-light information 108 
obtained from a sensor 109, and to reproduce the values as 
faithfully as possible by using profiles 103 and 106 of each 
device. Thus, color-appearance matching can be achieved. 

This method will now be described while referring to FIG. 
10. An input image (printed article) is read with a scanner 
101, and RjGjBi values obtained from the scanner 101 are 
converted into device- independent color signals XjYjZj in 
a scanner RGB-*XYZ converter 102 with the use of the 
scanner profile 103 in which scanner-characteristic data is 
stored. The color signals X^Zj are further converted in a 
signal converter 104, based on ambient-light information 
108 obtained from an ambient-light detecting sensor 109, 
into color signals X^^^Z^ of the respective colors to be 
observed under the ambient light. Then, a monitor profile 
106 is used to calculate monitor input values R 2 G 2 B 2 in an 
XYZ-*monitor RGB converter 105. 
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By employing the aforedescribed method, the colors 
represented by the same values in the common color space 
should appear the same. However, it is known that a color 
displayed on a monitor and the color of a printed article to 

5 be observed under illumination appear different to the 
observer even though both of the colors are represented by 
the same value. In order to solve this problem, further 
corrections are required to achieve color-appearance match- 
ing performed by visual observations under the above - 

10 described environment. 

The human eye is considered to recognize all of the colors 
in relation to the color white. This is further considered by 
taking an example in which an image displayed on a monitor 
and a printed article are observed under a certain type of 

15 ambient light (environment light). 

In the above-described environment, there may be various 
types of white colors (detectable white colors), such as white 
colors of a monitor, illumination light, and an image illu- 
minated with illumination light (paper white color). An 

20 observer in such an environment detects, considering all of 
the aforedescribed different types of white colors, a white 
color which is used as a reference for detecting the other 
colors. The observer thus observes other colors based on the 
reference white color. Hence, the following method is con- 

25 sidered to match the color appearance: a reference white 
color is determined in the above-described environment, and 
the other colors of all of the images are converted based on 
this reference white color. As an application of the above- 
described method, a technique disclosed in a thesis (SPIE 

30 Publication Vol. 2170 ppl70.-181.) is known. This thesis 
reveals a method for color-appearance matching in which a 
reference white color is determined based on the white color 
of a fluorescent lamp and the white color of a monitor under 
the fluorescent lamp, and color conversion is performed 

35 based on the determined reference white color to obtain 
color-appearance matching. 

The aforedescribed method for achieving color- 
appearance matching by determining a reference white color 

40 and converting all of the other colors based on this white 
color is sufficiently effective when color rendering is high 
under illumination light. However, any variation in the 
spectral distribution of illumination fight generally changes 
the resulting color stimulus values, and changes in the color 

45 stimulus values further vary depending on the spectral 
reflectance factor of a reflector. Accordingly, a sufficient 
degree of color- appearance matching cannot be expected 
merely by using the method of performing color conversion 
of all the colors based on a specific white color. 

50 SUMMARY OF THE INVENTION 

Accordingly, in view of the above background, it is an 
object of the present invention to achieve color-appearance 
matching of output images to input images irrespective of 
55 ambient light (observing light). 

It is another object of the present invention to implement 
highly-precise color-appearance matching of output images 
to input images by performing color conversion in consid- 
eration of ambient-light characteristics, such as color ren- 
60 dering. 

In order to achieve the above-described objects, according 
to one aspect of the present invention, there is provided an 
image processing method for performing color conversion 
of image data representing an input image so as to fulfil 
65 color-appearance matching of an output image to be repro- 
duced by an image output device to said input image, the 
method comprising the steps of: performing color- 
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conversion processing of image data representing an input FIG. 5 illustrates the spectral distributions of a fluorescent 

image obtained from an input device under a certain stan- lamp used as a typical standard light source D65, standard 

dard light source into image data dependent on a light source illuminance C, and a xenon lamp; 

used for observation; performing color-conversion FIG. 6 illustrates the spectral sensitivity characteristics of 

processing, based on a reference white color determined 5 three sensors used in an embodiment of the present inven- 

when an observation is made, of the image data dependent tion- 

on the light source used for observation; and outputting the ? mustrates ^ ^ sensilivi , characteristics for 

image data dependent on the reference white color to the obtaining , he tris tiniulus ; values XYZ; 

image output device. 

. . A c . . . 1fl FIG. 8 is a block diagram illustrating a third embodiment 

According to another aspect or the present invention, 10 „ f , • 4 - 

. . . • • . ac <> of the present invention; 

there is provided an image processing method for perform- r 

ing color conversion of image data representing an input FIG - 9 15 a block &*Z Tam illustrating the flow of data in 

image so as to fulfil color-appearance matching of an output ^ sl S nal converter 304 of FIG. 8; 

image to be reproduced by an image output device to the FIG- 10 is a block diagram of an example of conventional 

input image, the method comprising the step of performing 15 signal processing apparatuses; and 

color conversion of image data representing an input image FIG. 11 illustrates an environment in which an image is 

obtained from an input device under a certain standard light observed. 

source into image data produced in consideration of the 

characteristics of ambient light and chromatic adaptation DESCRIPTION OF THE PREFERRED 

which is performed based on a reference white color deter- 20 EMBODIMENTS 

mined when an observation is made. (First Embodiment) 

According to still another aspect of the present invention, Referring to a block diagram illustrating the data flow in 

there is provided an image processing apparatus for per- FIG. 1, a method for implementing color-appearance match- 

forming color conversion of image data representing an i n wn i cn a printed article is read with a scanner, and a 

input image so as to fulfil color-appearance matching of an 25 resulting image is displayed on a monitor so that it appears 

output image to be reproduced by an image output device to as tne same co j or as me printed article, 

the input image, the apparatus comprising: first color- An input image (printed article) is read by a scanner 301 

conversion means for color-converting image data repre- and mmtM inl0 an ^ signaL R G B data read by the 

senting an input image obtained from an input device under scanner 3Q1 ^ converted ^ device-independent color 

a certain standard light source into image data dependent on s{ ^ X Y Z m a mjMJ rgb _xy Z 302 

a light source used for observation; second color^conversion based 0Q lhe info™^ of a scanner-profile storage section 

means for color-converting the image data dependent on the 3Q3 in which characteristics are stored< ^ ^n- 

hght source used for observation, based on a reference white versioQ ^ orj each of the RGB signals 5y ^ a 

color determined when an observation is made; and output ]ook toW ^ { a characteristics ^ 

means for outputting the image data dependent on the account 
reference white color to the image output device. 

According to a further aspect of the present invention, r^'-lut^r^ 

there is provided an image processing apparatus for per- G^LUTJG^) 

forming color-signal conversion of image data so as to fulfil ^ Q 1 

color- appearance matching between an image displayed on b^vt^b^ 

a monitor and a printed article, the apparatus comprising: Thcn> the convcrsion from scanner RGB into XYZ is 

setting means for setting the type of ambient light; storage performed by using a 3x3-matrix MTX ROB2XYZ . 
means for storing in advance color-signal processing infor- 
mation on each type of the ambient light; and color-signal 
conversion means for performing color-signal conversion, 
based on the color-signal processing information corre- 
sponding to each type of the ambient light, of the image data, 
considering the characteristics of the ambient light and 

chromatic adaptation performed based on a white color of _ . (L . . * * • * j * 

the monitor 50 The color space used in this conversion is not restricted to 

. t . . t the XYZ color space. Any color space which compensates 

Further objects, features and advantages of the present fof differences in devices may u ^ d (for examp i e , the 

invention are apparent from the following description of the CIEL U V or QELAB color space), 

preferred embodiments with reference to the attached draw- ^ manner-profile storage section 303 stores data rep- 

m & s * 55 resenting color characteristics of the scanner 301 (the above- 

BRIEF DESCRIPTION OF THE DRAWINGS described color conversion matrix (RGB— XYZ) and LUT). 

.„ . „ , The resulting XjY.Z. signals are further processed in a 

FIG. 1 is a block diagram illustrating a first embodiment signa] C0Dverler 304 by reading from a color-signal process- 

of the present invention; information storage section 312 color-signal processing 

FIG. 2 illustrates a 77-color-patch test chart used for 60 information (more specifically, a 3x3-two-dimensional 

obtaining the coefficients of a matrix CR described in the matrix XYZ12XYZ2) corresponding to the type of ambient 

first embodiment; light obtained in an ambient-light-type determining section 

FIG. 3 is a block diagram illustrating a second embodi- 311 based on ambient-light information obtained by a sensor 

ment of the present invention; 310. The processed XjYjZj signals are then converted into 

FIG. 4 illustrates the spectral distributions of a CIE 65 X 2 Y 2 Z2 signals with a view to fulfilling color-appearance 

standard illuminance (A, C, D65) and a supplementary matching between a printed article and the image displayed 

standard illuminance (B) used as examples of ambient light; on the monitor under the image-observing environment. 
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FIG. 4 illustrates the spectral distributions of CIE stan- 
dard illuminant (A, C, D65) and supplementary standard 
illuminant B as ambient light. By virtue of different color 
temperatures of the above light sources, the type of the light 
sources is determined by measuring their color temperatures 
as ambient-light information. FIG. 5 illustrates the spectral 
distributions of a fluorescent lamp used as a typical standard 
illuminant D65, standard illuminant C and a xenon lamp. 
Color temperatures are not used for determining the types of 



The 3x3-matrix ^T^xyzircb aQ d me monitor-output 
gamma characteristics are stored in the monitor-profile 
storage section 306 as the information concerning color 
conversion from a standard color space into device- 
dependent color signals. Thereafter, the R 2 G 2 B 2 signals are 
sent to the monitor 307, and an image associated with the 
signals is displayed on the monitor screen. 

According to the above -described procedure, under the 
above-described image -observing environment, an image of 



the above-noted light sources. Thus, a sensor having a 10 a printed article is displayed on the monitor 307 in a color 

sensitivity in a range of a waveform of 700 nm or longer is similar to that of a resultant printed article, 

employed to compare the intensity levels of the light sources An explanation is now given for forming a color-signal 

in this range, thereby determining their type. Alternatively, conversion matrix XYZ12XYZ2, when an image is 

the type of light sources may be determined by using a observed, for example, under a certain type of illumination 

sensor having sensitivity in a very narrow range, including is light (environment light), as color-signal processing infor- 



the bright-line of a fluorescent lamp, and comparing the 
intensity levels of the light sources in this range. Hie method 
for determining types of different light sources is suitably 
selected depending on the spectral distributions of the light 
sources. 

The aforedescribed color-signal processing information is 
determined in relation to a plurality of types of ambient light 
by a below-described method, and a plurality of types of 
processing information are stored in the color-signal pro- 
cessing information storage section 312. The signal con- 
verter 304 executes conversion expressed by the following 
equations based on the matrix XYZ12XYZ2 stored in the 
color-signal processing information storage section 312. 



x 2 
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= XYZ12XYZ2 
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mation corresponding to the illumination light. The matrix 
XYZ12XYZ2 is found by operation of the following equa- 
tions. 
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The above matrix XYZ12XYZ2 is used for executing color- 
signal processing in accordance with the type of ambient 40 
light. 

A monitor-profile storage section 306 stores data repre- 
senting color characteristics of a monitor 307, such as the 
color temperature, the luminance, the chromaticity of a 
fluorescent material, and information indicating color con- 45 
version from a standard color space into a device-dependent 
color signal. 

Subsequently, the monitor-device-independent X 2 Y 2 Z2 
signals obtained in the signal converter 304 are converted, 
based on the monitor-characteristic information stored in the 50 
monitor-profile storage section 306, into device-dependent 
R 2 G 2 B 2 signals in the XYZ-*monitor RGB converter 305. 
This conversion is started by executing XYZ-» monitor 
RGB conversion with the use of a 3x3-matrix MTX xyz2 p GB . 



(3) 



55 



60 



Then, look-up table conversion is performed on each of 
the RGB signals in consideration of monitor-output gamma 
characteristics. 

R 2 -LUT R {RJ) 
B 2 =LUT B (B 2 >) 



65 



The above matrix M is used to convert the tristimulus 
values XYZ expressed by the CIEXYZ colorimetric system 
into the response values RGB corresponding to the level of 
the receptor (cones) of the human eye (see Foundations of 
Color Engineering p. 216, Asakura Shoten). X^Y^Z^ 
indicate the tristimulus values of ambient light (white color 
under image -observing environment). X^Y^Z^ which rep- 
resent the tristimulus values of the reference white, are 
found with the use of the tristimulus values X^Y^Z^ of 
the ambient light (white color under image -observing 
environment) and the tristimulus values X^Y^Z^ of the 
monitor according to the following equations: 

Z^(l-s) >Z wx+S-Z W2 

where X W Y^Z W designate the tristimulus values of a white 
color used to observe an image displayed on the monitor 
307. When an image displayed on the monitor screen is 
observed, the human eye is not completely adapted to the 
white color of the monitor, but become adapted thereto 
depending on the ratio of the white color of the monitor to 
the white color of the ambient light. Thus, the adaptation of 
the human eye to the monitor white color, i.e., parameters 
(adaptation ratio) representing an influence of the monitor 
white color upon the reference white in relation to the 
environment white color, are designated by s. The tristimu- 
lus values X W Y W Z W of the reference white are determined 
by the above-described equations. 
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The adaptation ratio s varies depending on the color 
temperature of ambient light and the background color of an 
image (background color of a monitor). If, for example, the 
background color changes from black to white with the gray 
scale level, the background color closest to the black color 
has a higher adaptation ratio to the ambient light. The 
tristimulus values of the ambient light and the tristimulus 
values of the monitor white color are measured with a 
calorimeter, such as a color-luminance meter. 

The matrix CR functions to convert color signals 
(XjYjZj) indicated with the use of a standard color space (a 
standard light source D65 or D50 used in a standard color 
space) into color signals (Xj'Y/Zj') obtained in consider- 
ation of the characteristics (spectral characteristics, color 



monitor image by both the white color of the monitor and the 
while color of ambient light). As a consequence, color- 
appearance matching between an input image and an image 
displayed on the monitor 307 is achieved. 
5 (Second Embodiment) 

A description is now given of another embodiment con- 
structed with the addition of a color-signal processing infor- 
mation calculating section 314 as part of the system, as 
illustrated in FIG. 3. In this embodiment, color-signal pro- 
10 cessing information is not obtained in advance, but is 
calculated in the calculating section 314 according to the 
ambient-light information obtained by the sensor 310. This 
calculation is performed using the following matrix calcu- 
lations which have been described as the method for deter- 



rendering, etc.) of a light source (ambient light) used when 15 mining the color-signal conversion matrix in the first 
an observation is made. A 3x3 matrix is used as the matrix embodiment. 
CR. The color signals (XjYVZ/) achieved taking the char- 
acteristics of the light source into account using the matrix 
CR are obtained from the color signals (XjYjZi) expressed 
in the standard color space according to the following 2 o [ R » 

equation. Rwi 



XYZ12XYZ2 ~ M~ l - D M -CR 



(6) 











= CR 




A 




Zi . 



(5) 



25 



The actual coefficients of the matrix CR are determined, 
based on data representing the measurements of the tris- 
timulus values under a certain type of illumination light and 
the color signals (the tristimulus values) expressed with the 
standard color space, by optimizing the coefficients accord- 
ing to the damped least squares method using a test chart 
formed of 77-color patches, as shown in FIG. 2. 
Alternatively, the tristimulus values under illumination light 
may be determined based on the spectral reflectance factor 
of the 77-color patches measured with a spectrophotometer 
and the spectral intensity distribution of the illumination 
light measured with a spectral luminance meter. Then, the 
actual coefficients of the matrix CR may be obtained accord- 
ing to the optimization method in a manner similar to the 
above method. The above-described measurement means 
are suitably selected as required. 

Conceptually, the matrix XYZ12XYZ2 is formed of, as 
illustrated in FIG. 9, two factors, such as the matrix CR and 
the matrix M"\D*M. The matrix CR is, as discussed above, 
used for converting the color signals (XjYjZJ expressed 
with a standard color space dependent on a standard light 
source, i.e, a scanner, into the color signals (X 1 f Y 1 'Z 1 ') 
obtained considering the characteristics of ambient light. 
Namely, the matrix CR functions to convert, based on the 
characteristics of a light source, such as color rendering, the 
XjYjZi signals dependent upon a standard light source into 
the XjTj'Zj' signals dependent upon ambient light. The 
other factor, i.e., the matrix NT 1 .DM, serves to convert, 
based on the theory of Von Kreis, i.e., the chromatic- 
adaptation prediction theory, the ambient-light dependent 
signals X 1 'Y I 'Z 1 ' into reference -white dependent signals 

to. 

In this manner, conversion is first performed based on the 
characteristics of ambient light, and then, chromatic adap- 
tation is predicted based on the image-observing environ- 
ment white and the reference white. Thus, highly -precise 
signal conversion is performed considering the characteris- 
tics of ambient light (spectral characteristics, color 
rendering, etc.) and the chromatic adaptation of the human 
eye (an influence produced upon the reference white of a 
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The above-described matrix M functions to convert the 
tristimulus values XYZ expressed by the CIEXYZ colori- 
metric system into the response values RGB associated with 
the level of human eye receptors (cones). X^Y^Z^ 
depict the tristimulus values of ambient light (white color 
under image-observing environment). X^Y^Z^ which 
indicate the tristimulus values of the reference white, are 
determined using the above tristimulus values X^Y^Z^ 
of the ambient light and the tristimulus values X^Y^Z^ 
of the monitor white color according to the following 
equations: 

Z vvK 1 --*) Z wi+rZyn 

where s represents parameters indicating the influence of the 
monitor white and the environment white upon the reference 
white. The tristimulus values of the ambient light and the 

55 tristimulus values of the monitor white color may be mea- 
sured with a colorimeter, such as a color- luminance meter 
for input into the system. In this embodiment, however, the 
values obtained in the sensor 301 are used as the tristimulus 
values of the ambient light. The sensor 301 is thus con- 

60 structed to output the ambient-light information as the 
tristimulus values XwoY^Zw^. The tristimulus values 
XwdY^dZwo represent the color of the ambient light (white). 
The circuitry of the apparatus in this embodiment is con- 
structed of three optical sensors exhibiting different spectral 

65 sensitivity characteristics, as illustrated in FIG. 6. The 
outputs R^qG^B^o in accordance with the respective char- 
acteristics are thus obtained from the three optical sensors. 
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The spectral sensitivity characteristics for obtaining the 
tristimulus values XYZ are indicated as shown in FIG. 7, 
and are different from the characteristics (FIG. 6) of the 
sensors used in this apparatus. Accordingly, conversion is 
required from the sensor outputs R^G^B^ to the tristimu- 5 
lus values X^Y^qZ^. In this embodiment, the conversion 
is performed with the use of a 3x3 matrix MTX senmr 
according to the following equation. 

(7) 10 



X w 








- MTX teruor 


Gso 









The above -described matrix calculation is performed in a 15 
digital signal processing circuit contained in the apparatus. 

The matrix CR is employed to convert the color signals 
(XYZ) expressed using a standard color space (a standard 
light source, such as D65 or D50, used in a standard color 
space) into color signals (X'YZ 1 ) produced considering the 20 
characteristics (spectral characteristics, color rendering, and 
so on) of a light source (ambient light) used when an 
observation is made. A 3x3 matrix is used as the matrix CR 
in this embodiment. The color signals (X'Y'Z 1 ) produced in 
consideration of the characteristics of the light source are 2 5 
converted using the matrix CR from the color signals (XYZ) 
indicated by a standard color space according to the follow- 
ing equation. 

(8) 30 







X 


r 


= CR 


Y 


r 







The actual coefficients of the matrix CR are determined, 35 
based on data representing the measurements of the tris- 
timulus values under a certain type of illumination light and 
the color signals (the tristimulus values) expressed with a 
standard color space, by optimizing the coefficients accord- 
ing to the damped least squares method using a test chart 40 
formed of 77-color patches, as shown in FIG. 2. 
Alternatively, the tristimulus values under illumination light 
may be determined based on the spectral reflectance factor 
of the 77-color patches measured with a spectrophotometer 
and the spectral intensity distribution of the illumination 45 
light measured with a spectral luminance meter. Then, the 
actual coefficients of the matrix CR may be obtained accord- 
ing to the optimization method in a manner similar to the 
above method. The above-described measurement means 
are suitably selected as required. 50 

The matrix CR produced in the above manner is stored as 
ambient-light-characteristic correcting information in an 
ambient-light-characteristic correcting information storage 
section 313. The matrix CR used for calculation is used in 
the following manner: the type of ambient light is 55 
determined, based on the ambient-light information obtained 
by the sensor 310, in an ambient-light-type determining 
section 311 in the manner discussed in the first embodiment, 
and the corresponding ambient-light-characteristic correct- 
ing information, i.e., the matrix CR, is selected using the 60 
information on the determined type of ambient light from 
the storage section 313. The other operations are similar to 
those of the first embodiment. 

In this embodiment, color signal processing information 
used in the signal converter 304 is obtained by making 65 
calculations in the color-signal processing information cal- 
culating section 314. With this construction, it is only 



essential that calculations be made to obtain color-signal 
processing information as ambient-light-characteristic cor- 
recting information which does not depend upon the monitor 
or chromaticity and luminance of the ambient light. Hence, 
the number of types of color-signal processing information 
required to be obtained and stored in advance is less than in 
the first embodiment. 
(Third Embodiment) 

A description is now given of a third embodiment, as 
illustrated in FIG. 8, constructed with the addition of an 
ambient-light-type designating section 315 as part of the 
system. 

The basic operation of this embodiment is substantially 
similar to the operation of the first embodiment. In the first 
embodiment, the ambient-light type is automatically 
determined, based on the ambient -light information obtained 
in the sensor 310, in the ambient-light type determining 
section 311 contained within the system. In this 
embodiment, however, a provision of the ambient-light type 
designating section 315 makes it possible to directly desig- 
nate the type of ambient light. This avoids recognition errors 
in the type of ambient light. It is also possible to display on 
the monitor, images to be observed under ambient light other 
than the current environmental conditions. The types of 
ambient light may be specified by selecting from the 
ambient-light numbers listed on the display screen with a 
mouse or a keyboard. In addition, the color temperatures and 
spectral characteristics may be displayed on the screen as a 
reference for designating the type of ambient light. 

According to the aforedescribed embodiments, a refer- 
ence white color is determined, considering all of the white 
colors detectable under observing environments. Color sig- 
nal processing is then performed using this reference white 
color so as to achieve color-appearance matching between 
an image on the monitor and a printed article. In order to 
implement the above color-appearance matching, sufficient 
consideration is given to the characteristics (spectral 
characteristics, color rendering, etc.) of ambient light when 
color signals are converted. More specifically, information 
(chromaticity values, XYZ tristimulus values, etc.) concern- 
ing the white color (white paper color) detected under 
illumination light (environmental light) is determined from 
information (chromaticity values, color temperatures, spec- 
tral intensity (illuminance), and so on) of the light. 
Additionally, information (for example, a two-dimensional 
matrix) for converting other colors is obtained. Then, color- 
signal conversion is performed based on the above- 
described overall information. 

According to the foregoing embodiments, color signals 
are converted with high precision in accordance with the 
ambient light of various light sources, thereby fulfilling 
highly-precise color-appearance matching between a moni- 
tor image and a printed article. 

In the aforedescribed embodiments, the theory by Von 
Kreis is used as the chromatic-adaptation prediction theory. 
However, other theories may be applicable. 

The present invention may be applicable to various con- 
structions based on hardware and the corresponding 
sequence processing. The sequence processing may be, for 
example, described logically or expressed in software. 
Alternatively, it may be formed into an algorithm within the 
spirit and scope of the present invention, and the present 
invention may be applicable as hardware or an apparatus 
according to the above algorithm. 

Further, the present invention may be used in a copying 
machine or a printer loaded with a preview function which 
serves to display a print preview image on a monitor. The 
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present invention is also applicable to a color management 
system for use in an image processing apparatus for per- 
forming various types of color signal conversions, such as 
for various types of input/output devices. Additionally, a 
look-up table may be formed based on XYZ12XYZ2, and 
chromatic-adaptation conversion processing in the signal 
converter 304 may be performed based on this table. 

The present invention may be applicable to a system 
comprised of a plurality of devices (for example, a host 
computer, an interface, a reader, and a printer) or formed of 
only one device (for example, a copying machine or a 
facsimile machine). 

Also, the following modification may be made to fulfil the 
above-noted functions loaded with the foregoing embodi- 
ments of the present invention. Software program codes for 
implementing the above functions may be installed in a 
computer within an apparatus connected to the various 
devices or in a computer within the system. Then, the 
various devices may be operated according to the program 
stored in the computer (a CPU or an MPU) within the system 
or the apparatus. 

In this case, since the software program codes per se can 
fulfil the functions of the aforedescribed embodiments, the 
program codes per se and means for supplying the program 
codes to a computer, for example, a storage medium in 
which the program codes are stored, can constitute the 
present invention. The storage mediums for storing such 
program codes may include floppy disks, hard disks, optical 
disks, magneto-optical disks, CD-ROMs, magnetic tape, 
no n- volatile memory cards, and ROMs. 

Needless to say the program codes installed in the com- 
puter may be included in the present invention if the 
functions of the aforedescribed embodiments are imple- 
mented by operating the program codes in cooperation with 
an operating system (OS) run on a computer or with another 
application software program. 

Further, the program codes may be naturally included in 
the present invention if the functions of the above-described 
embodiments are achieved in the following manner. Namely, 
the program codes are stored in a memory provided for a 
feature expansion board of a computer or a feature expan- 
sion unit connected to a computer, and then, a CPU or an 
MPU stored within the feature expansion board or the 
feature expansion unit completely or partially executes 
actual processing based on the program codes. 

As is clearly understood from the foregoing description, 
the present invention offers the following advantages. Color- 
appearance matching of an output image to an input image 
is achieved regardless of ambient light (observing light). 
Further, highly-precise color-appearance matching of an 
output image to an input image is fulfilled by performing 
color conversion considering the characteristics, such as 
color rendering, of ambient light. 

While the present invention has been described with 
reference to what are presently considered to be the pre- 
ferred embodiments, it is to be understood that the invention 
is not limited to the disclosed embodiments. To the contrary, 
the invention is intended to cover various modifications and 
equivalent arrangements included within the spirit and scope 
of the appended claims. The scope of the following claims 
is to be accorded the broadest interpretation so as to encom- 
pass all such modifications and equivalent structures and 
functions. 

What is claimed is: 

1. An image processing method of performing color 
processing wherein color image data indicated by means of 
a color system which is independent of device characteris- 
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tics are processed, depending on a property of environment 
light, said method comprising the steps of: 
inputting information of the environment light; 
performing correction of first image data to second image 
5 data in accordance with a color rendering property of 
the environment light, based on the information of the 
environment light; and 
performing conversion of the second image data to third 
image data in accordance with white information of the 
10 environment light, based on the information of the 
environment light.' 

2. An image processing method according to claim 1, 
wherein said color system is a XYZ color system. 

3. An image processing method according to claim 1, 
15 wherein said correction of image data is performed using a 

3x3 matrix. 

4. An image processing method according to claim 1, 
wherein said correction and said conversion are performed 
together by the table in accordance with the condition of said 

20 correction and said conversion. 

5. An image processing method comprising the steps of: 
performing correction of image data in accordance with a 

color rendering property of environment light; and 
performing conversion of the corrected image data in 
25 accordance with white information of the environment 
light, 

wherein said conversion comprises the step of predicting 
chromatic adaptation based on the white information of 
3Q the environment light and a reference white color 
determined when an observation is made. 

6. An image processing method according to claim 5, 
wherein said reference white color is generated from the 
white information of the environment light and a white color 

35 of an output device. 

7. A recording medium for storing a program for imple- 
menting an image processing method of performing color 
processing wherein color image data indicated by means of 
a color system which is independent of device characteris- 

4Q tics are processed, depending on a property of environment 
light, said method comprising the step of: 
performing correction of first image data to second image 
data in accordance with a color rendering property of 
the environment light; and 
45 performing conversion of the second image data to third 
image data in accordance with white information of the 
environment light. 

8. An image precessing apparatus for performing color 
processing wherein color image data indicated by means of 

50 a color system which is independent of device characteristic 
are processed, depending on a rpoperty of environment light, 
comprising: 

means for performing correction of first image data to 
second image data in accordance with a color rendering 
55 property of the environment light; and 

means for performing conversion of the second image 
data to third image data in accordance with white 
information of the environment light. 

9. An image processing apparatus according to claim 8, 
60 said apparatus further comprising: 

selecting means for selecting, based on the information 
regarding the environment light, correction data to be 
used by said correction means. 

10. An image processing apparatus according to claim 9, 
65 wherein said inputting means comprises a sensor. 

11. An image processing apparatus for performing color 
processing wherein color image data indicated by means of 
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a color system which is independent of device characteris- 
tics are processed, depending on a property of environment 
light, said method comprising the steps of: 

input means for inputting information of the environment 
light; 

correction means for performing correction of first image 
data to second image data in accordance with a color 
rendering property of the environment light, based on 
the information of the environment light; and 

conversion means for performing conversion of the sec- 
ond image data to third image data in accordance with 
white information of the environment light, based on 
the information of the environment light. 

12. A computer readable medium having recorded thereon ^ 
codes for implementing a computer implement able image 
processing method of performing color processing wherein 
color image data indicated by means of a color system which 

is independent of device characteristics are processed, 
depending on a property of environment light, said method 2Q 
comprising the steps of: 

inputting information of the environment light; 
performing correction of first image data to second image 
data in accordance with a color rendering property of 
the environment light, based on the information of the 25 
environment light; and 
performing conversion of the second image data to third 
image data in accordance with white information of the 
environment light, based on the information of the 
environment light. 30 

13. An image processing method for converting input 
image data into color image data indicated by means of a 



color system which is independent of device, said method 
comprising the steps of: 
inputting information relating to ambient light; and 
performing a conversion process on the color image data 
based on the information input in said inputting step, 
wherein the conversion process includes correction in 
accordance with a color rendering property of the 
ambient light and conversion in accordance with white 
information of the ambient light. 

14. A method according to claim 13, further comprising 
the step of converting the converted color image data into 
color data depending on a destination device. 

15. A recording medium, storing in computer-readable 
form, a program for causing execution of an image process- 
ing method for converting input image data into color image 
data indicated by means of a color system which is inde- 
pendent of device, said method comprising the steps of: 

inputting information relating to ambient light; and 
performing a conversion process on the color image data 

based on the information input step, 
wherein the conversion process includes correction in 

accordance with a color rendering property of the 

ambient light and conversion in accordance with white 

information of the ambient light. 

16. A record medium according medium according to 
claim 15, wherein said method further comprises the step of 
converting the converted color image data into color data 
depending on a destination device. 
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